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DESCRIPTION 

IMAGE PROCESSING METHOD, IMAGE PROCESSING DEVICE AND PROGRAM 

TECHNICAL FIELD 
The present invention relates to an image processing 
method, image processing device and program which are devised 
so that in cases where one image is divided into a plurality 
of regions and a projection transformation is performed for 
the image data of each region, these regions can be set in 
appropriate ranges . 

BACKGROUND ART 

In cases where photography is performed using a digital 
camera or the like, depending on the object of imaging, barrel 
type distortion in which the object of imaging bulges outward, 
or bobbin type distortion in which the object of imaging is 
indented inward, may be conspicuous. 

Accordingly, in order to correct such distortion, the 
image data that is picked up is input into a personal computer, 
and a correction such as a geometrical transformation or the 
like is performed on this personal computer. 

Techniques for performing such a geometrical 
transformation on images include the technique disclosed in 
Japanese Patent Application Laid-Open No. 2001-250114. 
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Patent Document 1: Japanese Patent Application Laid-Open No, 
2001-250114 

DISCLOSURE OF THE INVENTION 
Conceivable methods for performing a geometrical 
transformation on images using a personal computer include a 
method in which one entire image is transformed at one time, 
and a method in which one image is divided into a plurality of 
regions, and a transformation is performed for each region. 

In cases where one entire image is transformed at one 
time, the capacity of the RAM (random access memory) that 
stores the entire image that is the object of transformation 
(i.e., the image prior to transformation) must naturally be 
larger than in cases where one image is divided into a 
plurality of regions, and a transformation is performed for 
each region. Accordingly, the following problem is 
encountered: namely, in cases where this transformation is 
performed in parallel with other processing, a sufficient RAM 
capacity cannot be ensured, so that the image transformation 
takes time. In cases where a sufficient RAM capacity cannot 
be ensured, a virtual memory is formed on an HDD (hard disk 
drive) or the like, which has a slower transmission rate than 
the RAM, and processing is performed on this HDD; in this case, 
however, the processing time becomes even longer. 
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This task is also made redundant as the number of pixels 
in image pickup elements becomes increasingly greater, so that 
the amount of data in one image is increased. 

On the other hand, in cases where one image is divided 
into a plurality of regions, and a transformation is performed 
for each region, the setting of the regions is a problem. 
Specifically, the image that is obtained by photography 
includes distortion; accordingly, if this distortion is not 
taken into account in setting the regions, there is a danger 
that the data that is referred to in the interpolation of 
pixels or the like that is required for the geometrical 
transformation will not be contained in the regions that are 
set as the object of processing. 

The present invention was devised in the light of such 
conditions; it is an object of the present invention to 
shorten the processing time by dividing one image into a 
plurality of regions, and performing a transformation for each 
of these regions, and to set these regions in appropriate 
ranges. 

The image processing method of the present invention 
comprises a region setting step for setting first regions by 
partitioning an image obtained subsequent to transformation of 
the captured image by lines parallel to a horizontal axis and 
a vertical axis passing through an origin, and a 
transformation step for transforming second regions prior to 
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the transformation of the .image, which correspond to the first 
regions set by the processing of the region setting step, into 
the first regions by a projection transformation, and is 
characterized in that the first regions are set by the 
processing of the region setting step so that these first 
regions do not include the horizontal axis or vertical axis. 

The system may be devised so that first regions that 
contain at least either the horizontal axis or vertical axis 
in cases where these regions are set at a default size by the 
processing of the region setting step are further divided to 
produce regions that do not contain the horizontal axis or 
vertical axis. 

In cases where first regions that contain at least either 
the horizontal axis or vertical axis exist when set at the 
default size by the processing of the region setting step, the 
system may be devised in such a manner that the sizes of all 
of the first regions are altered so that none of the regions 
contains the horizontal axis or vertical axis. 

The image processing device of the present invention 
comprises region setting means for setting first regions by 
partitioning an image obtained subsequent to transformation of 
the captured image by lines parallel to a horizontal axis and 
a vertical axis passing through an origin, and transformation 
means for transforming second regions prior to the 
transformation of the image, which correspond to the first 



regions set by the processing of the region setting step, into 
the first regions by a projection transformation, and is 
characterized in that the region setting means sets the first 
regions so that these first regions do not contain the 
horizontal axis or vertical axis. 

The program of the present invention comprises a region 
setting step for setting first regions by partitioning an 
image obtained subsequent to transformation of the captured 
image by lines parallel to a horizontal axis and a vertical 
axis passing through an origin, and a transformation step for 
transforming second regions prior to the transformation of the 
image, which correspond to the first regions set by the 
processing of the region setting step, into the first regions 
by a projection transformation, wherein the first regions are 
set so that these regions are formed as regions that do not 
contain the horizontal axis or vertical axis by the processing 
of the region setting step. 

In the image processing method, image processing device 
and program of the present invention, images following the 
transformation of captured images are partitioned by lines 
parallel to the horizontal axis and vertical axis passing 
through the origin, so that first regions are set. Furthermore, 
second regions prior to the transformation of the images are 
subjected to a projection transformation into first regions 
corresponding to the set first regions. Moreover, the first 



5 



regions are set so that these regions do not contain the 
horizontal axis or vertical axis. 

The present invention makes it possible to obtain images 
in which distortion is reduced in a shorter time. 

Furthermore, the present invention makes it possible to 
read out image data that is the object of processing in a 
reliable manner from a storage part storing data for the image 
as a whole even in cases where a transformation is performed 
for each region. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an example of the 
construction of a personal computer applying the present 
invention; 

Fig. 2 is a diagram showing an example of an image prior 
to transformation, and an example of an image following 
transformation; 

Fig. 3 is a block diagram showing an example of the 
functional construction of the image transformation part; 

Fig. 4 is a diagram showing an example of a tile region, 
and an example of the image prior to transformation; 

Fig. 5 is an enlarged view of a certain region in Fig. 4; 

Fig. 6 is a diagram showing another example of a tile 
region, and another example of the image prior to 
transformation; 

Fig. 7 is an enlarged view of a certain region in Fig. 6; 
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Fig. 8 is a diagram showing a concrete example of the 
tile size; 

Fig. 9 is a diagram showing an example in which the tile 
size in Fig. 8 is altered. 

Fig. 10 is a diagram showing the interpolation of pixels; 

Fig. 11 is another diagram showing the interpolation of 
pixels; 

Fig. 12 is a flow chart illustrating the image 
transformation processing of the image transformation part; 

Fig. 13 is a diagram showing an example in which the tile 
size is altered; and 

Fig. 14 is a flow chart illustrating other image 
transformation processing. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Fig. 1 is a block diagram showing an example of the 
construction of a personal computer 1 applying the present 
invention. 

The CPU (central processing unit) 11 executes various 
types of processing in accordance with programs stored in the 
ROM (read only memory) 12, or programs that are loaded into 
the RAM (random access memory) 13 from the storage part 18. 
For example, image processing programs that perform various 
types of processing on images captured by means of a digital 
camera are stored in the storage part 18. Furthermore, data 
and the like required by the CPU 11 in the execution of 
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various types of processing are appropriately stored in the 
RAM 13. 

The CPU 11/ ROM 12 and RAM 13 are connected to each other 
via a bus 14. Furthermore, an input/output interface 15 is 
also connected to this bus 14. 

An input part 16 consisting of a keyboard, mouse and the 
like, a display consisting of a CRT (cathode ray tube), LCD 
(liquid crystal display) or the like, an output part 17 
consisting of a speaker or the like, a storage part 18 
constructed from an HDD (hard disk drive) or the like, and a 
communications part 19 which performs communications via a 
network, are connected to the input/output interface 15. 

If necessary, furthermore, a drive 20 is connected to the 
input/output interface 15, and a removable medium 21 
consisting of a magnetic disk, optical disk, optical-magnetic 
disk, semiconductor memory or the like is appropriately 
mounted in this drive 20. 

In the personal computer 1 constructed as described above, 
for example, images captured by means of a digital camera are 
input, and transformation processing that is used to correct 
barrel type distortion or bobbin type distortion contained in 
these images is performed. 

Fig. 2 is a diagram showing an example of an image in 
which the object of imaging shows barrel type distortion (an 
image in which barrel type distortion is generated) , and an 
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example of the transformed image that is obtained by 
transforming this image, in a case where a rectangular object 
of imaging is photographed. 

The object of imaging P appearing in the image prior to 
transformation shown on the left side shows a difference in 
length between the lower side and upper side, and a distorted 
curvature in lines oriented in the vertical direction, as a 
result of lens distortion. In the personal computer 1 shown 
in Fig. 1, transformation processing is performed on such an 
image, so that a post-transformation image (image shown on the 
right side) containing an object of imaging P' that expresses 
the original shape of the object of imaging is obtained. 

Furthermore, for example, the data of the image prior to 
transformation is input into the personal computer 1 (storage 
part 18) by mounting a removable medium 21 which is mounted on 
the digital camera (not shown in the figures) , and which 
stores the captured image, in the drive 20. 

Fig. 3 is a block diagram showing an example of the 
functional construction of the image transformation part 31 
that is realized by the execution of an image processing 
program by the CPU 11 in Fig. 1. 

In the image transformation part 31, as will be described 
in detail later, the image following transformation of the 
captured image is divided, and transformation processing and 
the like are performed in order with each of a plurality of 
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regions arranged in the form of tiles (hereafter referred to 
as "tile regions" for convenience) taken as objects. 

For example, when the user designates a specified image 
stored in the storage part 18 by operating the input part 16, 
and then gives instructions to perform transformation 
processing that corrects the distortion of this image, 
information indicating the size and amount of data of the 
designated image is input into the tile size determining part 
41. The tile size determining part 41 also has information 
relating to the capacity of the buffer (RAM 13) that is used 
to perform transformation processing, and determines the tile 
size (size of the tile regions) on the basis of information 
relating to the size and amount of data of the image, 
information relating to the capacity of the buffer and the 
like. 

Furthermore, the tile size determining part 41 determines 
the tile size, and also selects one tile region that is taken 
as the object of processing, and outputs information 
expressing the position of the tile region that is taken as 
the object of processing to the image region calculating part 
42. 

As will be described later, in cases where the tile 
region that is the obj ect of processing contains the 
horizontal axis or vertical axis passing through the origin 
(hereafter, referred to collectively as the central axes for 
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convenience) , the tile size determining part 41 alters the 
tile size so that this tile region does not contain the 
central axes. 

The image region calculating part 42 calculates the 
region on the image prior to transformation that corresponds 
to the tile region taken as the object of processing. 
Furthermore, the image region calculating part 42 calculates a 
rectangular or square region containing the calculated region 
on the image prior to processing, and outputs information 
expressing the position of the calculated region to the image 
data read/write part 43. 

The image data read/write part 43 reads out image data 
contained in the region calculated by the image region 
calculating part 42 from the storage part 18, and stores the 
read-out data in a pre-transf ormation data buffer 51 formed in 
the buffer 44. 

The transformation processing part 45 refers to the pre- 
transf ormation data stored in the pre-transf ormation data 
buffer 51, performs a projection transformation on the 
respective pixels, performs interpolation of the pixels (if 
necessary) , and stores the post-transformation data thus 
obtained in a post-transformation data buffer 52 formed in the 
buffer 44. 

The processing performed by the respective parts 
described above is performed for each tile region, and (for 
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example) when a single overall image with reduced distortion 
is stored in the post-transformation data buffer 52, the post- 
transformation data is output from the image transformation 
part 31. The data output from the image transformation part 
31 is again stored in the storage part 18, or is used to 
display a post-transformation image on the display. 

Next, the processing that is performed by the image 
transformation part 31 will be described. 

Fig. 4 is a diagram showing examples of the post- 
transformation image (tile region) and pre-transf ormation 
image . 

In cases where an image is captured by means of a lens in 
which the image is distorted, such as a fish-eye lens or the 
like, as is shown on the left side of the figure, an image is 
obtained in which the object of imaging (lattice) shows barrel 
type distortion. For convenience of description, only the 
distortion in the lateral direction is shown in Fig. 4 (the 
same is true in Fig. 6) . 

For example, as is shown on the left side of Fig. 4, in a 
case where the image following transformation is divided by 
lines parallel to the X axis (which is the horizontal axis) 
and Y axis (which is the vertical axis) passing through the 
origin, and the tile region that is the object of processing 
in this case is the upper left region indicated by shading, 
the image transformation part 31 calculates the corresponding 
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points ABCD on the pre-transf ormation image from the positions 
of the four vertices a, b, c and d. 

Here, the projection transformation will be described. 

The lens that is mounted on the digital camera or the 
like is ordinarily designed so that the relationship of the 
following equation (1) is substantially satisfied. 
[Equation 1] 

y = f x tan0 ... ( 1 ) 

In equation (1), "y" indicates the image height, M f" indicates 
the focal distance, and "9". indicates the half screen angle. 

In cases where an image is captured using a digital 
camera in which a lens satisfying this relationship is mounted, 
the rectilinear portion of the object of imaging is focused on 
the imaging plane as straight lines. Depending on the type of 
lens used, however, there may be lenses which are designed so 
that the relationship of equation (1) is not satisfied. 
Especially in cases where acquired using a broad-angle lens 
with a short focal distance is viewed, the rectilinear 
portions may appear to be clearly distorted as shown on the 
left side of Fig. 2. 

Furthermore, in the case of a fish-eye lens, the lens by 
nature is not designed with equation (1) as a goal, and also 
differs according to the projection system with respect to the 
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light-receiving plane, such as a three-dimensional projection 
system, equal-distance projection system or the like. 
Accordingly, the lens is designed from the outset with the 
presumption that the image will be distorted. 

Accordingly, the transformation based on the following 
equation (2) can be used as a transformation for reducing the 
distortion of images captured using a lens designed from the 
outset with the presumption that the image will be distorted. 
[Equation 2] 

LI = A x tan[y _1 (LO)] ... (2) 

In equation (2), "LO" indicates the distance of the pre- 
transf ormation image from the optical axis (center) , and "LI" 
indicates the distance of the post-transformation image from 

the optical axis. Furthermore, M y(0)" indicates the 
characteristics of the zenith angle and image height of the 
liens, and "A" is a. constant that stipulates the image pickup 
range. 

The distortion of the image as a whole is reduced by 
transforming the positions of the respective pixels contained 
in the pre-transf ormation image according to equation (2) . 
For example, in Fig. 4, when points A through D of the pre- 
transf ormation image are transformed by equation (2), points a 
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through d of the tile region are respectively calculated as 
the corresponding positions. 

Thus, post-transformation pixel positions corresponding 
to the pre-transf ormation pixel positions can be calculated by 
a transformation using equation (2) . Conversely, furthermore, 
pre-transf ormation pixel positions corresponding to the post- 
transformation pixel positions can be calculated by performing 
a reverse transformation using equation (2). 

Accordingly, the image region calculating part 42 shown 
in Fig. 3 determines the region consisting of points A through 
D on the pre-transf ormation image corresponding to the tile 
region that is the object of processing by calculating the 
respectively corresponding positions on the pre-transf ormation 
image from equation (2) for the four vertices a through d of 
the tile region that is the object of processing (Fig. 4). 

Furthermore, the image region calculating part 42 
calculates (for example) the rectangular region consisting of 
the points EBFD shown in Fig. 5 in order to read out the pixel 
data used in the processing performed by the transformation 
processing part 45. Fig. 5 shows an enlargement of the area 
in the vicinity of the points ABCD in Fig. 4; the region 
consisting of the points ABCD is contained in the rectangular 
region consisting of the points EBFD. 

Thus, in cases where no central axes are contained in the 
tile region that is the object of processing, a square region 
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(e.g., the region consisting of the points EBFD in Fig. 5) 
containing a region on the pre-transf ormation image 
corresponding to the tile region that is the object of 
processing is calculated by the image region calculating part 
42, and the data for the pixels contained in the calculated 
region (data for the pixels within the square consisting of 
the points EBFD) is read out from the storage part 18. 

As a result, the read-out of data can easily be performed. 
Specifically, in cases where the data for the pixels contains 
in the region consisting of the points ABCD in Fig. 5 (region 
containing curved lines) is read out, it is necessary to 
designate the positions of the respective pixels each time; on 
the other hand, in cases where the data for the pixels 
contained in the region consisting of the points EBDF (region 
consisting only of straight lines) is read out, this can be 
accomplished merely by designating the positions of the 
vertices. 

In Fig. 4, it was assumed that the tile region 
constituting the object of processing did not contain any 
central axes. However, as shown on the right-hand side in Fig. 
6, in cases where (for example) the tile region that is the 
object of processing in this case is a region that contains a 
central axis (the X axis in the case of Fig. 6), the tile size 
determining part 41 alters the tile size so that the tile 
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region that is the object of processing does not contain any 
central axes. 

Specif ically, in a case where the tile region with the 
points a'b'c'd' as vertices is taken as the tile region that 
is the object of processing, and the region on the pre- 
transformation image corresponding to this region is 
calculated from the reverse transformation of equation (2) , a 
region consisting of the points A'B'C'D' which has a curve 
that bulges slightly outward on the left side is calculated as 
shown on the left side of Fig. 6. 

Fig. 7 shows an enlargement of the region consisting of 
the points A'B'C'D' in Fig. 6. Here, as was described above, 
in a case where the vertices of a square consisting of the 
points A'B'C'D' are designated as the pixel region for which 
data is to be read out, only the region indicated by shading 
in Fig. 7 is designated. In other words, the region #1 
surrounded by a thick line on the left side is not designated, 
and the pixel data contained in this region #1 is not read out. 
Since the projection transformation, interpolation processing 
and the like are performed on the basis of the data that is 
read out, data that is the object of this projection 
transformation and interpolation processing is not read out in 
cases where the pixel region for which data is to be read out 
is thus designated. 
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Accordingly, in cases where central axes are thus 
contained in the tile region, the tile size determining part 
41 alters the tile size so that the tile region that is the 
object of processing is converted into a region that does not 
contain central axes, thus ensuring that the pixel data that 
is the object of the projection transformation and 
interpolation processing can be securely read out. 

Fig. 8 is a diagram showing a concrete example of the 
tile size. 

In Fig. 8, the overall tile region (overall image 
following transformation) is set at 400 x 300. Furthermore, 

the size of the respective tiles is set at 100 x 60. The 
region of the uppermost tier of the second column from the 
left is designated as tile region #1, the region beneath this 
is designated as tile region #2, and the region beneath this 
is designated as tile region #3. 

In cases where tile region #3, which contains the X axis, 
is the region that is the object of processing, the tale size 

determining part 41 alters the tile size to 100 x 30 and 
splits tile region #3 into two tile regions #3-1 and #3-2 as 
shown in Fig. 9, so that tile region #3 is converted into a 
region that does not contain the X axis. 

Thus, in cases where the tile region that is the object 
of processing is a region that contains a central axis, the 
tile size is altered so that this region is converted into a 
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region that does not contain a central axis, thus allowing the 
secure read-out of the pixel data that is the object of 
processing from the storage part 18. 

Furthermore, since only the pixel data contained in the 
region corresponding to the tile region is read out from the 
storage part 18 and taken as the object of processing, a 
sufficient amount of buffer (RAM 13) can be ensured compared 
to cases in which a single entire image is read out at one 
time, so that quick processing can be performed. 

Thus, the regions are calculated, and processing is 
performed by the transformation processing part 45 on the 
basis of the read-out pixel data. 

Specifically, the positions of the respective pixels for 
which data is read out are transformed according to equation 
(2) by the transformation processing part 45, so that an image 
in which distortion is corrected is obtained. In concrete 
terms, the region surrounded by the points A through D shown 
on the left side of Fig. 4 is transformed into a region having 
a shape that is free of distortion surrounded by the points a 
through d as shown on the right side of Fig. 4. Similarly, 
the region surrounded by the points A' through D' shown on the 
left side of Fig. 6 is transformed into a region having a 
shape that is free of distortion surrounded by the points a' 
through d' as shown on the right side of Fig. 6. 
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If necessary, furthermore, interpolation of the pixels 
can be performed by the transformation processing part 45. 

Figs. 10 and 11 are diagrams showing the interpolation of 
pixels . 

In a case where the pixels (hereafter referred to as 
"pixels of interest" for convenience) located in the positions 
(130, 60) on the post-transformation image (tile region) shown 
on the left side of Fig. 10 are interpolated, positions on the 
pre-transf ormation image corresponding to the pixels of 
interest, e.g., (100.4, 52.7), are specified by a reverse 
transformation using equation (2) , and interpolation is 
performed by means of the pixel values of pixels located in 
the vicinity of these specified positions. 

For example, in a case where the positions on the pre- 
transf ormation image corresponding to the positions (130, 60) 
on the post-transformation image are specified as (100.4, 
52.7), as is shown in Fig. 11, reference is made to the pixel 
value of pixel #1 located at the position (100, 52), the pixel 
value of pixel #2 located at the position (100, 53), the pixel 
value of pixel #3 located at the position (101, 53), and the 
pixel value of pixel #4 located at the position (101, 52), and 
the pixel of interest is interpolated. For instance, using 
the pixel values of these pixels #1 through #4, a relative 
determination is made from the value of the decimal point of 
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(100.4, 52.7). For example, a determination may be made by 
linear interpolation. 

Such projection transformation and interpolation 
processing are performed with the respective pixels contained 
in the tile region constituting the object of processing as 
objects. Furthermore, when the processing of all of the 
pixels contained in a certain tile region constituting the 
object of processing has been completed, the tile region taken 
as the object of processing is switched, and the processing is 
repeated until the processing of one entire image is completed. 

Next, the image transformation processing performed by 
the image transformation part 31 will be described with 
reference to the flow chart shown in Fig. 12. 

In step SI, the tile size determining part 41 sets the 
default tile size. The processing then proceeds to step S2, 
and the tile region that is the object of processing is 
selected. For example, as is shown in Fig. 8, tile regions 

with a size of 100 x 60 are set, and the tile region that is 
the object of processing is set from the region at the upper 
left. 

In step S3, the tile size determining part 41 judges 
whether or not a central axis is contained in the tile region 
selected as the object of processing. In cases where it is 
judged that a central axis is contained in this tile region, 
the processing proceeds to step S4, and the size of the tile 
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region that is the object of processing is altered as was 
described with reference to Fig. 9. 

Information (size, position) relating to the tile region 
selected by the tile size determining part 41 is output to the 
image region calculating part 42. 

In step S5, the image region calculating part 42 
calculates the region on the pre-transf ormation image that 
corresponds to the tile region constituting the object of 
processing from the position of this tile region. For example, 
as was described with reference to Figs. 4 through 7, regions 
that contain no curved lines are calculated as regions 
containing pixels to which reference is made. Information 
relating to the region calculated by the region calculating 
part 42 is output to the image data read/write part 43. 

In step S6, the image data read/write part 43 ensures 
memory (post-transformation data buffer 52) for storing the 
post-transformation data, and then proceeds to step S7, and 
ensures memory (pre-transf ormation data buffer 51) for storing 
the pre-transf ormation data, i.e., the pixel data contained in 
the region calculated by the image region calculating part 42. 

In step S8, the image data read/write part 4 3 reads out 
the pixel data contained in the region calculated by the image 
region calculating part 42 from the storage part 18, and 
stores this data in the pre-transf ormation data buffer 51. 
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In step S9, the transformation processing part 45 
performs a projection transformation, interpolation processing 
and the like on the respective pixels for which data is stored 
in the pre-transf ormation data buffer 51, and stores the post- 
transformation data in the post-transformation data buffer 52, 
In step S10, the transformation processing part 45 judges 
whether or not a projection transformation and the like have 
been performed for all of the pixels read out as pixels 
corresponding to the tile region that is the object of 
processing. In cases where it is judged that such a 
transformation has not been performed for all of the pixels, 
the processing returns to step S9, and the processing is 
repeated for the respective pixels. 

On the other hand, in cases where it is judged in step 
S10 that the projection transformation and the like have been 
performed for all of the pixels, the processing proceeds to 
step Sll, and the transformation processing part 45 then 
judges whether or not processing has been performed for all of 
the tile regions. In cases where the transformation 
processing part 45 judges in step Sll that processing has not 
been performed for all of the tile regions, the processing 
proceeds to step S12. 

In step S12, the tile size determining part 41 changes 
the tile region that is the object of processing, and repeats 
the processing from step S3 on. In cases where it is judged 
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in step Sll that processing has been performed for all of the 
tile regions, the processing is ended, and the data for one 
entire image with correction distortion is output from the 
image transformation part 31. 

The data that is output from the image transformation 
part 31 is again stored in the storage part 18, or is used to 
display an image on the display. 

Thus, since one image is divided into a plurality of 
regions, and processing is performed with the respective 
regions as objects of processing, processing can easily be 
performed even in cases where sufficient memory cannot be 
ensured. 

Furthermore, since the region that is the object of 
processing is designated as a region that contains no curved 
lines, read-out of the pixel data contained in the region that 
is the object of processing can easily be accomplished. 

Moreover, in cases where the tile region contains a 
central axis, the read-out of data is performed after the size 
is altered so that the region contains no central axis; 
accordingly, the failure of the read-out of pixels that are 
the object of the projection transformation and pixel data 
that is referred to in interpolation can be prevented. 

In the above process, in cases where the tile region that 
was the object of processing contained a central axis, the 
tile size was altered only for that region. However, it would 
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also be possible to devise the system so that the size of all 
the tile regions is altered in cases where some tile region 
contains a central axis. 

For example, in cases where the size of one entire image 

is 2X x 2Y (horizontal x vertical) , and the default tile size 

is A x B, the tile size is calculated from the following 

equations (3) and (4), and is altered to A' x B' . 
[Equation 3] 

Nx = X/A (Nx is an integer; the decimal portion is discarded) 
Ny = Y/B (Ny is an integer; the decimal portion is discarded) 

... (3) 

[Equation 4] 
A' = X/Nx 
B' = Y/Ny . . . (4) 

For example, as is shown in Fig. 8, in cases where the 

size of one entire image is 400 x 300 (X = 200, Y = 150), and 

the default tile size is 100 x 60 (A = 100, B = 60) , Nx = 2, 
Ny = 2 is calculated from equation (3), and A' = 100, B' = 75 
is calculated by substituting these values into equation (4). 

The sizes of all of the tile regions are altered by the 
values thus calculated, so that the tile regions shown in Fig. 
8 are altered to tile regions having the size shown in Fig. 13. 
In Fig. 13, all of the tile regions are altered to tile 

regions having a size of 100 x 75. 
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The alteration of the tile size may be accomplished by 
any desired method as long as the tile regions are converted 
into regions which thus contain no central axes. 

Here, the processing performed by the image 
transformation part 31, which performs an image transformation 
by altering the size of all of the tile regions in cases where 
a central axis is contained in any of the tile regions, will 
be described with reference to the flow chart shown in Fig. 14. 

In step S21, the tile size determining part 41 sets the 
default tile size, and then proceeds to step S22 and judges 
whether or not a central axis is contained in any of the tile 
regions . 

In cases where the tile size determining part 41 judges 
in step S22 that a central axis is contained in one of the 
tile regions, the tile size determining part 41 proceeds to 
step S23 and alters the tile size in accordance with (for 
example) the abovementioned equations (3) and (4). As a 
result, as is shown in Fig. 13, the tile size is altered so 
that no central axes are contained in any of the tile regions. 

On the other hand, in cases where it is judged in step 
S22 that no central axis is contained in any of the tile 
regions, step S23 is skipped. 

The processing from step S24 on is the same as the 
processing described with reference to Fig. 12. Specifically, 
in step S24, the tile region that is the object of processing 
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is selected by the image region calculating part 42, and in 
step S25, the region on the pre-transf ormation image that 
corresponds to this tile region that is the object of 
processing is calculated from the position of this tile region. 

In step S26, the post-transformation data buffer 52 for 
storing the post-transformation data is ensured; the 
processing then proceeds to step S27, and the pre- 
transf ormation data buffer 51 for storing the pre- 
transf ormation data is ensured. 

In step S28, the pixel data contained in the region 
calculated by the image region calculating part 42 .is read out 
from the storage part 18 by the image data read/write part 43, 
and is stored in the pre-transf ormation data buffer 51. 

In step S29, a projection transformation and 
interpolation processing are performed by the transformation 
processing part 45 for the respective pixels stored in the 
pre-transf ormation data buffer 51, and the post-transformation 
data is stored in the post-transformation data buffer 52. In 
step S30, a judgment is made as to whether or not a projection 
transformation and the like have been performed for all of the 
read-out pixels; then, in cases where it is judged in step S31 
that processing has been performed for all of the tile regions, 
the processing is ended. 

As a result of the above processing as well, tile regions 
that contain no central axes can be set, and the pixels that 
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are the object of processing can be reliably read out from the 
storage part 18. 

In the above description, a case was described in which 
the X axis was contained in the tile region. However, the 
tile size is also similarly altered to produce regions 
containing no central axes in cases where the Y axis is 
contained in the tile region, or in case where both the X axis 
and Y axis are contained in the tile region. 

The abovementioned series of processing operations can be 
performed by means of hardware, or can be performed by means 
of software . 

In cases where this series of processing operations is 
executed by means of software, the programs constituting the 
software can be installed in a computer assembled with special 
hardware, or (for example) an all-purpose personal computer 
which can execute various types of functions by the 
installation of various types of programs, from a network or 
recording medium. 

As is shown in Fig. 1, this recording medium can be 
constructed from a removable medium 21 that is used to 
distribute programs to the user separately from the device 
proper, and that consists of a magnetic disk (including 
flexible disks), optical disk (including CD-ROM (compact disk 
read only memories), DVD (digital versatile disks)), optical 
magnetic disk (including MD (registered trademark (Mini-Disk) ) , 
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semiconductor memory or the like. Alternatively, such media 
can be constructed from a ROM 12 in which the programs are 
recorded, a hard disk contained in the storage part 18 or the 
like, which is provided to the user beforehand in a state in 
which this medium is built into the device proper. 

Furthermore, in the present specification, the steps 
describing the programs recorded in the recording medium may 
of course be processing that is performed in a time series in 
accordance with the order described, but also includes 
processing that is performed in parallel or separately rather 
than necessarily being performed in a time series. 
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